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ABSTRACT 

The presumption that increased media utilization 
yields better results was tested at Los Angeles Pierce College 
(California). To study the effect of media on the learning and 
attitudes of students in the public speaking (Speech I) class ^ two 
matched groups of 41 subjects were treated identically, except that 
the experimental group used tape recorders to record their speeches 
for self- evaluation* At the end of the semester both groups were 
evaluated by three college speech teachers, and the experimental 
group of students completed questionnaires designed to reveal their 
attitudes toward their own speaking, their improvement In speech, the 
course, and the audio playback technique* Conclusions reached 
Indicated that the audio playback of student speeches was of some 
value in improving student attitude toward the course, the students' 
specific vocal skills, and the students' ratings of themselves* Audio 
playback had no noticeable effect on students' attitudes toward 
either their own speaking or their improvement in speaking. 
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Background * P* )>nneth Komoskl of the Educational Products Information 



Exchange Institute testified before a House sub*conBilttee that the largest group 
of unprotected consumers In the U*S* consists of millions of students who are 
deluged with poorly tested teaching machines and other complex gadgets* Be 
estimated that 99% of the nation's teaching materials never have been ays terns tlcally 
tried out to see how much they aid In the learning process (Time [June 7, 1971) p33)« 
In the field of speech the use of audio taping is connonly accepted as a means 
that can aid In the acquiring of speaking skills* One researcher noted that the 
tape recorder Is "the most adaptable of the audlo*vlsuaI media tools, because It 
Is easily used and provides significant Individualization of instruction" (Renner, 
Speech Teacher , [Sept* 1967) p217)* But, Oallinger In discussing the purposes and 
uses of recorders observed, "ther^ seems to be a dearth of valid Information about 
what a student really learns from recording his speech" (Ibid, p209)* 

The audio tape recorder has been used intermittently by various speech 
Ins tixic tors at Pierce College with no direct, controlled testing of Its Instruc- 
tional effect. The presuaqitloa that Increased media utilization yields better 
results needed to be tested In the speech classes at Fierce* 

Statement of the problem. It was the purpose of this study to discover the 
effect of media upon the learning and the attitudes of students In public speaking 
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Class. In pursuing this purpose answers to the following 
research questions were sought^ 

1. What effect did the audio playback of the 
student's speech have upon the student's attitudes 
toward (a) his own speaking, (b) his improvement 
in public speaking, (c) various attributes of the 
course? 

2* What effect did the audio playback of the student'; 
speech have upon the student’s vocal skills as 
rated by a panel of experts? 

3* What effect did playback of student speeches 
have upon the ability of a student to rate his 
own public speaking in the area of voice? 

Answering the above questions was accomplished by testing 
the following hypotheses: 

1* There is no slgnlflceuit difference in student 
attitude toward his own public speaking between 
the group which heard the playback of their 
speeches (experimental group) and the group 
which did not hear the playback of their 
speeches (control group). 

2. There Is no significant difference in student 
attitude toward his improvement in public speaking 
between the experimental and control groups* 

3* There is no significant difference in student 
attitude toward the course between the experi- 
mental and control groups* 
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4. There Is no significant difference in specific 
vocal skills between the experimental and 
control groups. 

5. There is no significant difference in the 
correlation of student self»ratlng and expert 
ratings in the area of voice between the 
experimental and control groups. 

6. The frequency of the use of audio playback of 
student speeches had no correlation with rating 
of student attitudes toward the course, his 
speaking and his improvement, or his specific 
vocal skills as rated by expert judges. 

Method . The experimental method was used in this study 
to provide appropriate controlled tests of the null hypotheee 

Sampling Procedure . Two matched groups of 4l subjects { 
were selected by frequency matching according to the followln 
criteria: (a) age, (b) sex, (c) year in college, and (d) pre 

vious public speaking experience. These characteristics are 
represented in TkBLE I for each of the two groups. The s 
were selected from four Speech I classes taught at prime 
hours hy the same instructor. Experimental s were selected 
from two of the classes and control s from the other two 
classes. 

No use was made of SCAT or other IQ scores in matching 
the groups. Bryan and VUlke ( Journal of Applied Psychology . 
•June, 1942 , 371-Sl) showed there was no reliable relatlonshl 
between audience evaluation of a speech and the speaker’s 
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performance on standard tests 
Ball (Speech Monographs, XKV 
low correlation (.24 and «02) 
reasoning ability* 



of intelligence and personality* 
Nov*, 1958 , 285-90), found very 
between speech shills and general 



TABLE 1 

CfimCTERlSTICS OF EXPERIMENTAL AND CONTROL GROUPS 



Age 

mean 


Experimental Group 


Control Group 


20*6 years 


20.5 


standard deviation 


4*0 


4.4 


sex 


Male 




58.5^ 


Female 


36.6J8 


4l.5je 


Tear in College 


First 


46.3^ 


41.5JS 


Second 


53.7^ 


58.5^ 


Public Speahir 4 g Experience 


1 year 


4*9)1 


4.9^ 


2 or more 


0 


0 



Data Collection Procedures * Each member of the experi- 
mental group was required to purchase an audio cassette tape 
at the beginning of the semester* At the time of each speech 
each experimental s brought his tape to class; his speech was 
recorded, and he was given the tape and told to listen to it 
in the learning center on his own time* Both groups were given 
an oral critique by the Instructor and an instructor-produced 
written evaluation of the speech after each speech* All 
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procedures for the classes of the control group were Identical 
to the experimental group with the exception that the experi- 
mental g3?oup had its speeches recorded* At the end of the 
semester both groups were video recorded in an ungraded speech 
assignment* !The video recording was played before three 
expert evaluators (Speech instructors with more than 7 years 
college speech teaching experience) who recorded ratings for 
each s in six categories of analysis (see APPENDIX A)* !The 
evaluators were given specific definitions for each of the six 
categories* In a previous similar situation the reliability 
of the three evaluators was tested and found to be highly 
similar* 

At the end of the semester students in the experimental 
and control groups were given a questionnaire with questions 
designed to discover student attitude toward 1) his own 
speaking, 2) his improvement in speech, and 3) ^he course. 

(see APPENDIX B)* Appropriate measures were taken to assure 
anonymity of the respondents as well as Identlf Icatlon for 
matching with raters* scores* Responses to the questionnaire 
were quantified and punched on computer cards* 

A second part of the questionnaire, examining student 
use of audio playback of speeches and student attitude toward 
the audio playback technique, was administered to the 
experimental group only (see APPENDIX C)* These data were 
also quantified and placed on computer cards fcr analysis* 

Data Analysis * A .test of significance between the two 




means of independent samples was run on each item of the 



questionnaire administered to both groups* IThis provided a 
test of hypotheses 1-4. Question 2 in the questioainaire was 
used to test the first hypothesis. The second hypothesis 
was tested by questions 3 said 4. Question 1 provided the 
test for hypothesis 3 , The fourth hypothesis was tested by 
comparing the means of the judges* scores for the two groups 
(question 5 ). 

A Pearson linear correlation was computed between the 
student self*rating in question 5 und the judges* ratings 
of the speakers for both experimental and control gro**ps. 

The r coefficients were transformed to z scores and a t test 
was nm to test the difference of the z scores for the two 
groups. These procedures provided a test of hypothesis 5* 

A Pearson r was used to measure the correlation between 
the frequency of the use of the audio playback of speeches • 
as represented in* question 7 of the questionnaire administered 
to the experimental group, and the ratings on the questionnaire 
in items 1 * 5 * 

Findings . A comparison of the means of the ratings for 
the two groups together with their respective t values are 
represented in TABLE II* At the .05 level of significance 
only one item (Id) showed a significant difference of the 
means* However, since item Id is only one of five items 
designed to yield student attitude toward the course, one 
cannot completely reject the entire null hypothesis three with 
much confidence. Hypotheses one, two, and four are clearly 
not to be rejected on the basis of the t values represented 
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in TaBl£ II* 

!The correlation between student self-evaluation and rater 
evaluation of students is represented in 0!ABLB III for both 
groups* The r coefficients were transformed to z scores* 
and t tests for significant difference between the ratings 
for the two groups were run for the largest difference in 
scores in the seune trait for the same rater. When the test 
did not yield a t value of significance at the .05 level it 
was not necessary to test for the other differences. As a 
result null hypothesis five was not rejected. The means 
by rater combined with traits (T&BLE XV)* however* indicated 
a consistently favoraHe rating for the experimental group. 

The correlation of the frequency of the use of audio 
playback of speeches within the experimental group and their 
ratings on items of the questionnaire is represented in V. 

The frequency of the use of audio playback was derived from 
question 7 and is represented in TABLE VI. The correlations 
were not high enough to warrant a rejection of null hypothesis 
six. 

Discussion and Conclusions . It would seem that since 
none of the null hypotheses could be rejected by the tests 
applied in this study* the use of audio playback of student 
speeches was of no significant value. But several observations 
are important at this point. 

First* as several authorities have observed* it is fre- 
quently the specific use of a medium or the orientation to it 
rather than the medium itself which makes the difference. 
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In this study, inadequate orientation to the medium could 
aooount for a minimized effect. 

Seoond, in the correlation of the frequenoy of use of 
audio playback with ratings on the questionnaire in item 6 
(see XaBLG V), the moderately high oorrelations (*46, .48, 

^d . 59 ) showed that students who used the playhaok of speeches 
more regarded it more highly. 

!Third, in comparing the expert raters* scores for the two 
groups as represented in XV, it was noted that in 21 

of the 24 comparisons the experimental group reoeived a more 
favorable rating than the control group. On tne basis of 
chance the probability of this ocourring is less than .01. 

!Thus, it can be said that the experimental group did prediotab'^y 
better than the control group when rated by expert Judges, but 
not at the level of significance as meas^u:ed by the t wjt. 

A similar conclusion can be drawn from observing the 
difference be;;ween the correlation of student self-evaluation 
and xater evaluation as represented in XA.BLE 1X1. In 23 of 24 
comparisons the correlation was higher in the experimental 
than the control group. The probability of this ocourrance 
on the basis of chanoe alone is less than .005* It can be 
concluded that the experimental group self-evaluation was pre- 
dictably more like the expert raters* than was the control 
group. No t tests were run to test for the difference between 
these oorrelations, but observation of the greatest difference 
in correlation indicated that there would be no significant 

dlfferenfifl At, -fch* -CC 
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!The above observations revealed that the t test at the 
*05 level of significance vias too strong an instrument to 
yield the differences between the experimental and control 
groups in most oases* There was, however, substantial consis- 
tency of lesser differences observed. It Is this researcher's 
recommendation that the study be replicated using different 
tests for significance. The tests in this study prevented 
a type I error (rejecting an hypothesis which should not 
be rejected) very effectively but did not. In this researcher's 
opinion, adequately guard against a type II error (failing 
to reject an hypothesis which should be rejected). 

The r^^searcher concluded the followings 

1. The audio playback of students* speeches had a 
significant favorable effect upon the students* 
image of the course as a constaructlve rather 
than destructive force. 

2. The audio playback of students* speeches had a 
consistent but small favorable effect upon the 
correlation between student self-evaluation 
and expert i*ater evaluation. 

3* The audio playback of students* speeches had a 
consistent but small favorable effect upon 
student achievement in specific vocal skills 
as measxired by expert rater evaluation. 

4. None of the null hypotheses was rejected. 

5* New tests of significance need to be applied 
to variables In this study* 
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6* Those who used the audio playback more tended 
to regard its use more highly. 

In summary, the audio playback of student speeches was 
shown to be of some value in improving student attitude 
toward the course, in improving the students' specific vocal 
skills and improving the students' ratings of themselves* 
Audio playback had no noticeable effect upon student attitude 
toward his own speaking or student attitude toward his 
improvement in speaking. 
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XABUi II 

C0KI>kiiISOi\ UP HilTIiJGS Puri IHri 

liXPtiHlKi:;iMTHL MW COi^TriOL GriOUPS 



X " experimental .;^roup 



y = control group 



tion 


Group 


nean 


St. i3ev. 


t value 


la 


X 


•).73 


.?b 


1.02 


y 


3.5'* 


.95 




lb 


X 

y 


?.51 

?.?4 


.67 

.97 


i .32 


lo 


X 

y 


2.17 

l.aS 


.97 

.96 


1.4d 


Id 


X 

y 


2.12 

1.76 


.73 

.73 


2.19 signlflci 


le 


X 

y 


2.bb 

2.51 


.64 

i.Ob 


1.7X 


2 


X 

y 


2.63 

2.5^ 


.99 

.37 


0.47 


3a 


X 

y 


2.93 

2.?S 


.76 

.79 


0.B6 


3 b 


X 

y 


* * 

o o 
o 


.76 

.64 


0.14 


3c 


X 

y 


* * 

o o 
o o 


.76 

.63 


0.00 


3d 


X 

y 


2.63 

2.46 


1.07 

.71 


• 0.65 


3e 


X 


2.66 


.93 


-1.20 


y 


2.90 


.70 


3f 


X 

y 


2.90 

2.93 


.92 

.99 


-0.12 



ERIC 

Mi’lliilSlilRlffTIIEB . 
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Tabu? II (continued) 



ERIC 

MMilRlffTIILiU 







lyiean 


• Dsv • 


t value 


3g 


X 


3.20 


1.03 




y 


2.93 


.96 


X • 22 


4 


X 


3.02 


.82 


0.00 




y 


3.02 


.76 


5a 


X 

y 


2.73 

2.88 


.87 

.75 


•0.82 


5b 


X 


2.66 


.97 


0.24 


y 


2.71 


.84 


5c 


X 


2.90 


.86 


0.69 


y 


2.78 


.73 


5d 


X 


2.88 


.75 


0.80 


y 


2.76 


.62 


5e 


X 


2.88 


.75 


-0.86 


y 


3.02 


.79 


5f 


X 


2.93 


.76 


0.48 


y 


2.85 


.62 
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ERIC 

U/WilRlffTlTLiU 



■UbLd 111 

CoiiHiiLaTlOu SrUDhiM'i' SELP-siViiLUAriOil 

aiND Hii'mi'S K'/ALUa‘XIOiJ OF STUOEWT 



ii JCFEh IKhiv iii L 



. XPiirtT ^ S . 

iaXiiit 


ilate 


Pitch 


‘iPtlC 


Fluency 


Phrasing 


Total 


iiffect 


oC 


.09 


• 04 


• ?.2 


-.37 


• 10 


. 1 ^ 


la 


• 06 


.31 


.09 


.13 


.09 


• 14 • 




.05 


• ?0 


• 36 


-•03 


• 1 ? 


• 32 



COWTROt 





• 02 


-•34 


-•12 


-• i .0 


-•09 


• 08 


% 


.03 


-•06 


-.20 


*^.13 


.03 


-.04 


% 


• 00 


• 00 


• 04 


-.12 


-•03 


• 17 
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Haters Traits 



by groups 


PITCH 


RaTE 


AHTICU- 

lATION 


FLUENCY 


PHRASING 


EFFECT- 

IVENESS 


X 


2.71 


2.83 


2.81 


2.73 


2.66 


2.88 


y 


3.22 


3.27 


3.20 


3.10 


3.22 


3.12 


X 


3.22 


3.00 


3.17 


3*00 


2.73 


3.24 


y 


3.1? 


3.29 


3.00 


3.10 


2.95 


3.12 


X 


2.85 


2.88 


2.95 


2.73 


2.63 


3.02 


y 


3.2? 


3.22 


2.98 


3 . 3 '^ 


3.05 


3.15 






X ' « 


experluental 


group 







X = control group 

note: smaller soores are more favorable 



i'.E/lNS OF HaTINGS BY ii/vIEB COMBINED WITH TH6.IT 



TaBLS IV 






CuEKjiLftTIud OF Tiib OF US£ OF AUDIO FL^iJ^n^VCK 

WII'H AAXIi\)GS OK THK <iUHSTIOKNiiIHA 




1* Xhls semester*3 course in public speaiclng vjas; 



a* easy - difficult *A5 

b* Interesting - dull *••02 

c, relevant - Irrelevant *11 

d, constructive - destructive *01 

e, inspiring - discouraging .05 



2* During the semester, I feel my public speaking has improved s 



greatly - not at all .15 

3* I would characterize my speech as being; 

a. expressive - dull .1^ 

b. dynamic - lethargic .29 

c. precise - Imprecise #12 

d. organized - disorganized .11 

e# articulate - Inarticulate -.22 

f. fluent - halting -.12 

g. confident - lacking confidence -.06 
In general I am a 



very good speaker - very poor speaker ,20 
5. uate the following factors In your own speaking: 



a# Hate ,lA 

b. Pitch ,29 

c, Artie ,17 

d , Fluency - , 09 

e. Phrasing -,1A 

f* Effectiveness .29 



TiiBLi) V (continued) 



6, rtie tape recordlnji; of speeches v^ass 



a • 


useful - useless 


• 4o 




convenient - inconvenient 


.46 


c. 


rorthvrhile - ’^rorthless 


.59 




TABLE VI 



PRfcQUENCr OP USE OF AUDIO PLAYBACK 
OP SPEECHES 

(experimental group only) 



Times Used 



Number of subjects 



0 

1 

2 



4 

5 
7 



3 

4 

5 

6 



12 

6 

4 

3 

total n*4l 



Wean of times used » 2*85 



APPENDIX A 



EXPERT RATERS 

Student number 
1. Pitch 


• POBW FOR BATING STUDENT SPEECHES 

L J 1 1 L 


J 






6X0 6 xxont 








pbor 


2 . 


Bate 


1- A 


\ 


* 


1 


J 






excellent 








poor 


3 . 


Articulation & 












Pron\mciation i t 


i 


i 




1 






excellent 








poor 


4. 


Fluency 


t j 


1 


1 


1 


1 






excellent 








poor 


5. 


Phrasing A 














Word Choice 


1 1 


1 


J 


- 1 


* 






excellent 








poor 


6. 


Over-all 














Effectiveness i \ 


1 


-t 


1 — 


1 



excellent poor 



A?PLi'»DIX B 



QUESTXONNAXBE FOR MX SUBJECTS 



X.D. 



!• This semester's course in public speaking vast 



a • easy 



b. interesting 
J 



c. relevant 

t L 



d. constructive 

e. 'insplrlhg 



t 






axmcuxt 



■^rrr 



J 



*Trreiev€uit 



± 



destructive 

*dlsCoUtHging 



2. During the semester, X feel that my public speaking h^s 
improved: 



L 



greatly 



X 



± 



± 



1 



not at aj 



3* X would characterize my public speaking as being: 



a. expressive 
X- 



b. dynamic 

c. 'pTedlStd ‘ 



d • organized 

I- - I 

e. articulate 



I 



X 



f. fluent 
g* * confident 



L 



' dull 



letnargic 

^ i npr g gtEg* 

i } 



'disorganized 



1 



J 



inarticulate 



halting 



J 



xacKihg 
confidence 



4. In general X am a 

^'very'"gooi''speaEer^ 



* Very p'bbf^ speaker 



o 
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5* Bate the following factors in your own speaking, 
a. Bate (appropriateness) 



'excellent 



T\r\rkif^ 



APPENDIX B (con’t) 



b. Pitch (variety & control) 

J L J_ ^ 



excellent 

c. Articulation & Proniinoiation 



t 



± 



X 



poor 



4 



excellent 

d. Fluency 
i L. 



poor 

J i 



excellent 

e. Phrasing & Word Choice 

I 1 1 L 



poor 



4 



J 



excellent 

f* Over-all Effectiveness 

I 1 L L 



excellent 



poor 



poor ^ 



appendix c 

QUESTIONNAIRE FOB EXPEHBiENTAL SUBJECTS ONLY 



6. 



The tape recording of speeches was: 



L I I 1 = i 



1. 

a* 


1 

useful 


1 




useless 


1, 


I 


i 


i 


1 J 


b. 


convenient 






inconvenient 


1 


1 


I 


1 


I _ 1 


c* 


worthwhile 






worcniess 



7» During the semester I listened to the playback of 

0 1 2 3 4 5 6 tapes 

of my speeches* 

8* The use of recordings of student speeches In speech 
classes should be continued discontinued - - 

no opinion • 

9» The use of recordings of student speeches In speech 

classes should be optional required „ 

no opinion • 



22 






o 



